Stopping times for quantum Markov chains
نویسندگان
چکیده
منابع مشابه
Eecient Stopping Rules for Markov Chains
Let M be the transition matrix, and the initial state distribution , for a discrete-time nite-state irreducible Markov chain. A stopping rule for M is an algorithm which observes the progress of the chain and then stops it at some random time ?; the distribution of the nal state is denoted by ?. We give a useful characterization for stopping rules which are optimal for given target distribution...
متن کاملStopping rule reversal for finite Markov chains
Consider a finite irreducible Markov chain with transition matrix M = (pij). Fixing a target distribution τ , we study a family of optimal stopping rules from the singleton distributions to τ . We show that this family of rules is dual to a family of (not necessarily optimal) rules on the reverse chain from the singleton distributions to a related distribution α̂ called the τ -contrast distribut...
متن کاملMarkov chains and mixing times
For our purposes, a Markov chain is a (finite or countable) collection of states S and transition probabilities pij, where i, j ∈ S. We write P = [pij] for the matrix of transition probabilities. Elements of S can be interpreted as various possible states of whatever system we are interested in studying, and pij represents the probability that the system is in state j at time n+ 1, if it is sta...
متن کاملMarkov Chains and Mixing Times
Titles in this series are co-published with the Mathematical Sciences Research Institute (MSRI).
متن کاملMarkov Decision Processes with Constrained Stopping Times
The optimization problem for a stopped Markov decision process is considered to be taken over stopping times constrained so that E 5 for some xed > 0. We introduce the concept of a randomized stationary stopping time which is a mixed extension of the entry time of a stopping region and prove the existence of an optimal constrained pair of stationary policy and stopping time by utilizing a Lagra...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Theoretical Probability
سال: 1992
ISSN: 0894-9840,1572-9230
DOI: 10.1007/bf01060433